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Abstract. This paper studies limit theorems for Markov Chains with gen- 
eral state space under conditions which imply subgeometric ergodicity. We 
obtain a central limit theorem and moderate deviation principles for addi- 
tive not necessarily bounded functional of the Markov chains under drift 
and minorization conditions which are weaker than the Foster-Lyapunov 
conditions. The regeneration-split chain method and a precise control of 
the modulated moment of the hitting time to small sets are employed in the 
proof. 
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Resume. Nous etablissons dans ce papier des theoremes limites pour des 
chaines de Markov a espace d'etat general sous des conditions impliquant 
l'ergodicite sous geometrique. Sous des conditions de derive et de minorisa- 
tion plus faibles que celles de Foster-Lyapounov, nous obtenons un theoreme 
de limite centrale et un principe de deviation moderee pour des fonction- 
nelles additives non necessairement bornees de la chaine de Markov. La 
preuve repose sur la methode de regeneration et un controle precis du mo- 
ment module de temps d'atteinte d'ensembles petits. 
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1. Introduction 



This paper studies limit theorems and deviation inequalities for a positive 
Harris recurrent Markov chain {Xk}k>o on a general state space X equipped 
with a countably generated cr-field X . Results of this type for geometrically er- 
godic Markov chains are now well established: see for instance ([Mevn and Tweedie 
1993, Chapter 17) for the c e ntral li mit th e orem and the law of iterated loga- 



rithm, 



de Acosta and Chen (199 



Chen ( 1999) for moderate deviations re- 



sults. However, the more subtle subgeometrical case is not nearly as well un 
derstood (see for instance 



Diellout and Guillin 



i200ll )) 



These results can be obtained by using the regeneration method constructed 
via the splitting technique on returns to small sets. These methods typically 
require bounds for modulated moments of the excursions between two regen- 
erations. In practice, one most often control the corresponding modulated 
moment of the excursion between two small set return times rather than re- 
generation times. Our first result in section |2] relate these two bounds, ex- 
te nding to subgeometric a case results reported earlier in the geometric case 
bv iRoberts and Tweedid (|1999l ). We then apply these bounds in sections 00 
and |SJ In section E 3 we establish a C LT and Berry-Esseen bounds, sharpening 
estimates given in iBolthausenl ((1982). In section ^ we establish a Moderate 
Deviation Principle for possibly unbounded additive functionals of the Markov 
chains, ex tending results obtained ea rlier for bounded functionals and atomic 
chains bv lDiellout and Guillinl (|200ll ). Finally, in section we give deviation 
inequality fo r unbounded additive func t ionals of the Markov Chain. 

Following iNummelin and TuominerJ (J1983J) , we denote by Ao the set of se- 
quences such that r(n) is non decreasing and log r(n)/n J, as n — > oo and by 
A the set of sequences for which r(n) > for all n E N and for which there 
exists an ro £ Aq which is equivalent to r in the sense that 



< lim inf — y^- 

n-»oo ro(n) 



and lim sup 



r(n) 



< oo . 



r (ra) 

Without loss of generality, we assume that r(0) = 1 whenever r S Ao- Examples 
of subgeometric sequences include: polynomial sequences r(n) = (n + l) 5 (5 > 
0), or sub exponential sequences, r(n) = (n + l) s e cn "' (5 > 0, c > and 7 € 

(0,1)). 

Denote by P the transition kernel of the chain and for n > 1, P n the ra- 
th iterate of the kernel. For any signed measure [i on (X, X), we denote by 



iMll/ 



def 



sup| 9 |<j \fJ-(g)\ the /-total variation norm. Let / : X — > [1, 00) be 
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a measurable function and {r(k)} G A. We shall call {X k } (/, r)-ergodic (or 
/-ergodic at rate {r(k)}) if P is aperiodic, ^-irreducible and positive Harris 
recurrent Markov chain and 

lim r(n)\\P n (x, •) - 7f\\f < oo , for all x G X . (1.1) 

n— >oo 

where tt is the unique stationary distribution of the chain. If (|l.lj) holds for 
/ = 1, then we call {^fc} r-ergodic (or ergodic at ra te r). For positive Har- 



ris recurrent Markov chain ([Mevn and Tweedid . Il993l . Chapter V) there exists 



some (and indeed infinitely many) small sets satisfying for some constant m 
and some probability measure v, the minorisation condition: P m (x,-) > ez/(-), 
x G C. In what follows, for simplicity of exposition, we shall consider the 
"strongly aperiodic case" m = 1, that is 

A 1. There exist e G (0, 1], a probability measure v on (X, X) such that v{C) = 
1 and for all x G C, A G Af, P(x,A) > 

The general m case can be straightforwardly, but to the price of heavy no- 
tations and calculus (considering for example easy extensions of i.i.d. theorem 
to the 1-dependent case), recovered from the proofs presented he re. Funda- 



ment al to our methodology will be the regeneration technique (see (|Nummelin , 



19841 . chapter IV). The existence of small sets enables the use of the split- 
ting construction to create atoms and to use regeneration methods, similar 
to those on countable spaces. In particular, each time the chain reaches C, 
there is a possibility for the chain to regenerate. Each time the chain is at 
x G C, a coin is tossed with probability of success e. if the toss is success- 
ful, then the chain is moved according to the probability distribution u, oth- 
erwise, according to (1 — e)™ 1 {P(x, •) — ev {■)'}. Overall, the dynamic of the 
chain is not affected by this coin toss, but at each time the toss is success- 
ful, the chains regenerates with regeneration distribution u independent from 
x. We denote by r = inf{A; > l,X k G C} and a = inf{& > 0, X k G C} the 
first return and hitting time to C and by f = inf {k > 1, (Xk,dk) G C x {1}} 
and <7 = inf {A; > 0, (X^jd^) G X x {1}}. Let / be a non-negative function 
and r G A a subgeometric sequence and (i a probability measure on (X,X). 
Our main result gives a bound to the (/, r)-modulated expectation of moments 
^2^=1 r (^)/P0c) °f the regeneration time (where is the expectation 
associated to the split chain; see below) in terms of the corresponding moment 
of E M [J2J c =o r (k)f(Xk)] and constants depending only and explicitly on e and 
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v and on the sequence r. Here, E M denotes the expectation associated to a 
Markov chain with initial distribution fi and moving according to P outside C 
and the residual kernel (1 — e)~ 1 {P(x, •) — ez/(-)} inside C. 

Because finding bounds for E M EI=o r (k)f(Xk)] is not always easy, we will 
consider bounds for this quantity deri ved from a " subgeometric" condition re- 



cently introduced in lDouc et alJ (|2004l ). which might be seen, in the subgeomet- 
rical case, as an analog to the Foster-Lyapunov drift condition for geometrically 
ergodic Markov Chains. We obtain, using these drift conditions, explicit bounds 
for the (/, r)-modulated expectation of moments of the regeneration times in 
terms of the constants in .A[T| the sequence r and the constants appearing in 
the drift conditions. With these results, we obtain limit theorems for addi- 
tive functionals and deviations inequalities, under conditions which are easy to 
check. 

2. Bounds for regeneration time 



We proceed by recalling the construction of the split chain (jNummelinl . 1 1984 



Chapter 4). For x € C and A € X define the kernel Q as follows, 

(1 - €l c {x)Y l {P(x, A) - et c (x)v(A)} < el c (ac) < 1, 



Q(x,A) 



2.1) 

6 X (A) etc(x) = 1 



Define now, on the product space X = X x {0, 1} equipped with the product 
cr-algebr 
follows: 



o--algebra X ® V(0, 1) where V(0, 1) d = {0, {0}, {1}, {0, 1}} the split kernel as 



P(x,0;Ax{0})= [ Q(x,dy){l-el c (y)} P(x, 0; A x {1}) = eQ(x, A n C) 
J A 

P(x, I] Ax {0}) = I v{dy){l - el c (y)} P(x, I; Ax {1}) = ev(A n C) . 

J A 

For fj, be a probability measure on (X, X), define the split probability jl on 
(Xx{O,lU0P({O,l}) by 

jl{A x {0}) = / {1 - el c (y)Mdy) , A G X , (2.2) 

J A 

p.{A x {1}) = en(AnC) . (2.3) 

We denote by and the probability and the expectation on (X N x {0, 1} N , 
X N <g> V m ({0,l})) associated to the Markov chain {X n ,d n } n >o with initial 
distribution fi and transition kernel P. The definition of the split kernel implies 
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that 

P (* n+ i E A | T* V = P(X n , A) (2.4) 

P (dn = 1 1 T* V = el c (X n ) (2.5) 

P (x n+1 E ^4 | JFjf V d n = l) = u(A) , (2.6) 

where for n > 0, JT^ = cr(dfc, k < n) and by convention .Ff^ = {0, 0). Condition 
(|2.4|) simply states that {X n } n >o is a Markov chain w.r.t. the filtration {T^ V 
•7^-1,™ > 0). Condition (gSJ means that the probability of getting a head 
(d„ = 1) as the n-th toss is equal to etc(X n ), independently of the previous 
history and of the n — 1 previous toss. Condition (|2.6|) says that, if head is 
obtained at the n-th toss (d n = 1), then the next transition obeys the transition 
law v independently of the past history of the chain and of the tosses. This 
means in particular that X x {1} is a proper atom. From conditions (|2.4|) . (|2.5|) 
and (|2.6|) . we have 

P (x n+1 E A | Tn V d„ = 0) = Q(X„, A) . 

We denote respectively by P^ and E M the probability and the expectation on 
(X , A?® ) of a Markov chain with initial distribution fi and transition kernel 
Q. 

Denote by {&j}j>o are the successive hitting times of {X n } to the set C 

def 

o"o = inf {n > 0,X n E C} and Gj = inf{?i > (jj_i,X n E C}, j > 1 , 

(2.7) 

and by iV n the number of visits of {X n } to the set C before time n, 

n oo 

N n = ^ lc(Xn) = ]T l {CT .< n} (2.8) 

i=0 j=0 

Define by a the hitting time of the atom of the split chain X x { 1 } , 

,r= f {£;>0,4 = l} . (2.9) 

The stopping time a is a regeneration time and v is a regeneration measure, 
i.e. the distribution of X n conditional to a = n is v independently of the past 
history of the chain. The following proposition relates the functionals of the 
regeneration time under the probability associated to the split chain P^ to the 
corresponding functionals of the chain {X n } under the probability P M . 
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Proposition 1. Assume A\l[ Let \i a probability measure on (X, X). Let {£ n } 
be a non-negative T x -adapted process and let S be a T x -stopping time. Then, 



e)" s l{S<oo}] - 



% [Zsl {S <*}} =E M [&(1 



oo 

E< 

j=0 



(2.10) 
(2.11) 



The proof is given in the Appendix El 

We will now apply the proposition above to functionals of the form £ n := 
X^fc=o r (^)fl'(^fc) where g is a non-negative function and r £ A is a sequence, to 
relate the bounds of the (g, r)-modulated expectation of moments of regenera- 
tion time to the (/, r)-modulated expectation of moments of the hitting time. 

Proposition 2. Assume AlH Let {r(n)} n >o be a sequence such that, for some 
K, r{n + m) < Kr{n)r(m), for all (n, m) £ N x N. Let g : X — ► [1, oo) be a 
measurable function. For x £ X, define 



W r ,g(x) = E x 



,fe=l 



(2.12) 



Then, for any x £ X ; 



Ei 



£>(%(X fe 



,fc=o 



< 



r(0)<7(a:) + WV, S (^ l C c(x) + e-^l-e)^ (sup W^J E^[r(*)] . (2.13) 
If q = 1 and r(n) = /3 n , this proposition may be seen as an extension of 



( Eoberts and Tweedid . Il999l . Theorem 2.1), which relates the generating func- 
tion of the regeneration time to that of the hitting time to C. Subgeometric 
sequences r £ Ao also satisfies the inequality r(n + m) < r(n)r{m). There is 
however a striking difference with geometric sequence. Whereas for a geometric 
sequence lim infj^oo r(n)/ Y^=o r (^) > ®i f° r subgeometric sequence we have 
on the contrary limsup n ^ oc r(n)/ Y^=o r (^) = ^- This implies that, whereas 
E5 Ylk=o r (k)9(Xk) and [r(cr)] are of the same order of magnitude in the 
geometric case, the second is negligible compared to the first one in the subge- 
ometric case. In particular, 
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Corollary 3. Assume JFR For any function g : X — > [0,oo), there exists a 
constant b g (depending only and explicitly on e and sup^rWi g ) such that 



E 



S x 



.k=0 



< g(x) + W 1 Jx)\ C c{x) + b g . 



(2.14) 



For any r £ Aq and 5 > 0, there exists a constant b r (depending only and 
explicitly on e, 5, r and sup c W r ^\) such that 



E 



S x 



j2m 



.k=0 



< (l + 5)W r> i(x)l C c(x)+br ■ 



(2.15) 



In general, of course, sup c Wi >g and sup^ W r> i is not easy to find analytically 
and, as in other approaches to this problem, we will consider bou nds on these 
quant ities using " subgeometric drift" conditions as introduced in 



Douc et al 



l 2004 ) , generalising a con dition im plying rieamnnian c onverg ence stated in 
Jarner and Roberts! (|200lh (see also iFort and Moulinesl (|2000|) ) . This condi- 
tion may be seen as an analogue for subgeometrically ergodic Markov chain of 
the Foster-Lyapunov condition for geometrically ergodic Markov chain. 

A 2. There exist a concave, non decreasing, differentiable function (p : [1, +oo) — > 
BL + , a measurable function V : X — > [l,oo) and positive constants b satisfying 
ip(l) > 0, lim u _>oo <p{ v ) = oo, lim-u-xxj tp'(v) = 0, sup x&c V(x) < oo and 

PV < V - ip o V + bl c , 

where the set C is given in AfTl 

This drift condition has been checked in a large number of examples arising 
for example in qu eueing theory, Markov Cha i n Monte Car l o, tim e-series analysis 



(see for example iJarner and Roberts! (|2001MDouc et alJ (|200j)). Examples of 
functions <p satisfying A|2]include of course polynomial functions (p(v) = (v +l) a 
for a € (0, 1) but also more general functions like (p(v) = log a (t> + 1) for some 
a > 0, or ip(v) = (v + d)/ Ior(v + d) a , fo r some a > and sufficiently large 



constant d. We refer to 



Douc et al 



(|200J) for precise statements giving both 



drift functions and rate ip for these examples. Define 

. dcf r dx 
Ji n x ) 

The function $ : [1, oo) — > [0, oo) is increasing and lim^ 



(IDouc et al 



20041 . Section 2)). Define, for u G [1, oo) 



rju) d = ip o $ l {u)/ipo^ ^0), 



(2.16) 

oo (see 

(2.17) 
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where <1> _1 is the inverse of The function u t— > r^(u) is log-concave and 
thus the sequence {r„(^)} is subgeometric. Polynomial functions ip(v) = v a , 
a G (0, 1) are associated to polynomial sequences r ip (k) = (1 + (1 — a)k) a ^ l ~°^ . 
Functions like <f(v) = c(v + d)/log a (v + d) (a G (0, 1) and sufficiently large d) 
are associated to subexponential sequences, 

r^n) x n ^ Q /( 1+a ) exp ({c(l + a)n} 1 K 1+a A . 

where for two sequences {u^} and {ffc} of positive numbers, x i/^ if 

< lim inf — < lim sup — < oo . 



(Douc et al 



2004 Proposition 2.2) shows that, under for all x G X, 



E, 



IE* 



re— 1 
. k=0 

T C -1 

fc=0 



< V{x) + b\ c {x) , 
<{y(x)-l + Ml)l C (z)}Ml) • 



(2.18) 



(2.19) 



This implies, using iTuominen and Tweedid (|1994f ) that a Markov Chain sat- 
isfying _A^3E1 is both (1,7-^)- and (/, l)-ergodic. Denote by Q{<-p) the set of 
measurable functions satisfying: 



^)^{^:[l,oo) 



tp is non decreasing, ip ftp is non increasing} 



Similarly to (|2.16[) . for all ip G Gip), define the function 

: v i— ► / —(u)du . 
Ji V 



(2.20) 



(2.21) 



The function $^ is concave, non decreasing and, because [ip/tp](u) < [ip/ip](l), 
&i/}(u) < [ijj/(p](l) (u — 1) for all u > 1. The results of the previous section are 
used to derive explicit bounds for 



Ei 



k=0 



and E; 



.k=0 



where ip is any function in G(ip). The following theorem, proved in section lEl 
establishes bounds for the modulated moment of the excursion of the split chain 
to the atom X x {1} as a function of the drift condition. 



Theorem 4. Assume t OITH Then, there exists finite constant (depending 
only and explicitly on the constants appearing in the assumptions ) such that for 
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all x G X, tp G 



IE .5 



k=0 



< ^oV(x)t C c{x) + B^ , 



(2.22) 



For any 5 > 0, there exists a finite constant (depending only and explicitly 
on the constants appearing in the assumptions and 5 > 0) such that 



o x 



fc=0 



< {l + 5)V(x)l C c(x) + B v , 



(2.23) 



For any c G (0, 1) and K > 1, there exists a finite constant k (depending only 
and explicitly on the constants appearing in the assumptions) such that for any 
ip G G{^>), and x G X, 



\k=0 



1 



+ 



{cM/if>(K)} (l-c)MK 



V{x) , 
(2.24) 



The rates of convergence for the tail of the excursions may be obtained by 
optimizing the choice of the constant K with respect to M. As an illustration, 
consider first the case where ip = 1. Since lim^oo f(s) = oo, then 



lim Ml 

K^co K 



lim 



1 



K 



ds 



. 



K—too K Ji <f{s) 

Therefore, by letting K — > oo in the right hand side of Q2.24[) and then, taking 
c = l, 

f- 8x (a > M) < kV{x)/^~ 1 {M) . 

Note that this bound could have been obtained directly by using the Markov 
inequality with the bound (|2.23|) of the /-modulated moment of the excursion. 
Consider now the case: ip = ip. By construction, for any K > 1, ($^(if) + 
1)/K < 1 and for any positive u, <J? _1 (u) > (p(l)u + 1. Taking K = 1 in ((2~2^|) . 
Theorem |I] shows that, for some constant k, 

f L > M J < kV{x)/M , 

\fc=0 / 
which could have been again deduced from the Markov inequality applied to the 
bound for the excursion (|2.22j) . The expression (|2.24j) thus allows to retrieve 
these two extreme situations. Eq. 1)2.24(1 also allows to interpolate the rates for 
functions growing more slowly than ip oV. 

We give now two examples of convergence rates derived from the previous 
theorem by balancing the two terms of the right hand side appearing in © . 
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Polynomial ergodicity. By Eqs (|2.16|) and l|2.17|) . if ip(v) = v a (with a G 
(0, 1)), then r v {k) = (! + (!- a )k) a/(1 ~ a) and fc-^u) x (1 - a)V(i-a) u V(i-«) 



as ii -> oo. Choose /3 E (0, a) and set V ; (' u ) 



Then, <f> f (v) = (1 + 



(3 — a) l (v l+ P a — 1) and the optimal rate in the right hand side of (|2.24|) is 
obtained by setting K = M^+t^X 1 -") . With this choice of K, (|2~2"4"|) implies 
that 



> M 



.fc=0 



< kV(x)M a+(a-/3)(l-a) 



This bound shows how the rate of convergence of the tail depends on the tail 
behavior of the function g and of the mixing rate of the Markov Chain. 
Subexponential ergodicity. Assume that <p(v) = c(v + d)(log(u + d))~ a for 
some positive constants c and a and sufficiently large d. Then ^ 1 (k) x 
e (c(i+a)fc) 1 /(i+ Q \ Choose for example ip(v) = | log |^(1 + v), v E R+. By op- 
timising the bound w.r.t. K, (|2.24j) yields: 



J2\tegf[V(X k )} >M 



k=0 



-cM 1 + a +l 3 



V(x), 



for some constants c and C which does not depend of (3 or M. Similarly, for 
ip(v) = (1 + v)P with (3 E (0, 1), there exists a constant n < oo, 



Y,W{X k )>M 



k=0 



-1 2a/3-l+j3-q 

<kM^ log (M)F(x) . 



3. Central Limit Theorem and Berry-Esseen Bounds 

As a first elementary application of the results obtained in the previous sec- 
tion, we will derive conditions upon which a Central Limit Theorem holds for 
the normalized sum S n (f) = n -1 / 2 X^ILi(/(^fe) ~ 7r (f)) where ir is the station- 
ary distribution for the chain. For u, v two vectors of M. d , denote by (it, v) the 

1 /2 

standard scalar product and ||u|| = ((u,u)) 1 the associated norm. 

Theorem 5. Assume ^4 fTUH Let tp be a function such that ip 2 and ip^^ belong 
to Gyp). Then, for any function / : X — > K such that supx < oo, 

/ fdTT + / l/l £ " < °° • 

fc=l 

If in addition c 2 (/) > 0, where 

a r r r 00 

<T 2 (f)= J{f-7r(f)} 2 dir + 2 y /£p*{/-7r(/)}d7r, (3.1) 



fc=i 
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then, for any initial probability measure fi on (X, X) satisfying < oo, 

\/nS n (f) converges in distribution to a zero-mean Gaussian variable with vari- 
ance <r 2 (/). 

Polynomial ergodicity: Assume that ip(v) = v a for some a E (1/2,1) and 
choose i/f(y) = v p for some G [0,a]. Then, $ f (v) = (1 + - a)- l (v l+ ^~ a - 1) 
and the conditions of theorem ED are satisfied if a > 1/2 and £ [0, a — 1/2] . 



This is equivalent to the condition used in the CLT (jJarner and Robert 



2001 



Theorem 4.4) for polynomially ergodic Markov chains. Note that, if a < 1/2, 
then the moment of order two of the hitting time a is not necessarily finite, and 
the CLT does not necessarily holds in this case. 

Subexponential ergodicity: Theorem |5] allows to derive a CLT under con- 
ditions which imply subexponential convergence. Assume that <p(v) = (d + 
v)\og~ a (d + v), for some a > and sufficiently large d. The condition of 
Theorem |21 are satisfied for ip(v) oc v 1 / 2 {log(u)}-( a+ *) for 5 > 0. 

By strengthening the assumptions, it is possible to establish a Berry-Esseen 
Theorem with an explicit control of the constants. 

Theorem 6. In addition to the assumptions of Theorem suppose that the 
functions ip s , i^> 2 ^^ and ifi^^^ belong to G{<p). Let n be a probability measure 
on (X, A 7 ) such that ^{Q^) < oo. Then, there exist a constant k depending 
only and explicitly on the constants appearing in the assumptions (J^SM an ^ 
on the probability measure fj, such that, for any function f : X — ► K such that 

supx J^y < 00 and 0-2 (/) > °> 



sup 

t 



n- l / 2 S n (f)/<r(f) <tj- G(t) 
where G is the standard normal distribution function. 



< nri 



-1/2 



(3.2) 



Berry-Esseen theorems have been obtained for H arris-recurrent Ma rkov chains 
under moment and strongly mixing conditions bv iBolthausenl (|1982f ). The use 
of the results obtained above allow to check these conditions directly from the 
drift condition. A side result, which is not fully exploited here because of the 
lack of space, is the availability of an explicit computable expression for the 
constant k, which allows to investigate to assess deviation of the normalized 
sum for finite sample. This provides an other mean to get "honest" evalua- 
tion of the convergence of the Mark ov chain, under conditio ns which are less 
stringent than the ones outlined in Uones and Hobertl (|200ll ) , based on total 
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variation distance. 



rived in ( Bolthausen 



t is in teresting to compare our conditions with those de- 
1982 . Theorem 1), in the polynomial case, i.e. <p(v) = v a 



a G (0,1). It is straightforward to verify that the conditions of the Theorem 
IH1 are satisfied by i/j(v) = v@ if a > 2/3 and (3 G [0, a — 2/3]. O n the other 



Douc et al 



hand, the strong mixing rate of this chain is r(n) = n~ a /^ l ~°^ (see 
( 20041 ) and the maximum value of p such that Tr(V p P) < oo is p = a/ j3. The 
Bolthausen condition X^fcLi A;( p+3 )/( p ~ 3 V(n) < oo, is therefore satisfied again if 
a > 2/3 and (5 G [0, a — 2/3), the value a — 2/3 being this time excluded. 

4. Moderate deviations 

The main goal of this sec t ion is to generalize the MDP result of Djellout- 
Guillin iDiellout and GuillirJ l[200lf ) from the atomic case to the 1-small set 



case. We will indicate in the proof the easy modifications needed to cover the 
general case. 

4.1. Moderate deviations for bounded functions. We first consider MDP 
for bounded mapping, including non separable case (the functional empirical 
process and the trajectorial case). 

Theorem 7. Assume conditions J HWiH Then, for all sequence {b n } satisfying, 
for any e > 0, 



lim 

n— >oo 



n K 
n 



0. 



-oo 



(4.1) 
(4.2) 



for all initial measure fi satisfying fi(V) < oo, for all bounded measurable func- 
tion f : X — ► M. d such that vr(/) = and for all closed set F C M. d , we have 

lim sup £ log F u (^J2f(X k ) G F) < - mf J f (x) , 



fc=0 



where Jj is a good rate function, defined by 

J f (x) d ^ sup ((A,x)-(1/2) CT 2 (A,/)), 

and <r 2 is defined by (|3.1j) . 



(4.3) 



The proof is given in section El de Acostal (1 199 71 ) proved that the moderate 
deviation lower bound holds for all bounded function and all initial measure 
provided that the chain is ergodic of degree 2, i.e. for all set B G X such 
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that -k(B) > 0, f B E x [Tg]Tr(dx) < oo, where t b = inf{k >l,X k e B} is the 
return-time to the set B. It turns out that, under the assumptions .AlTll2| the 
condition (J4.1|) - (|4.2ft implies that the Markov chain is ergodic of degree 2. Note 
indeed that the conditions (j4.1|) - (j4.2j) implies that lim^oo k/r ip (k) = 0. The 
definition ()2.17j) of {r v (k)} implies that for some positive c, (f(v) > for 
any v G [l,oo) and Lemma [T2*l (stated and proved in section [DJ) shows that 
this condition im plies that the cha in is ergodic of degree two. Thus, Theorem 
□ together with |de Acostal . Il997l . Theorem 3.1) establish the full MDP for 
bounded additive functionals. 

Condition (|4.1|) - (|4.2|) linking ergodicity and speed of the MDP may be seen 
as the counterpart for Markov chains of the condition of Ledouxl ( 1992 ) for the 
MDP of i.i.d. random variable linking the tail of this random variable with the 
speed of the MDP. Let us give examples of the range of speed of the MDP 
allowed as the function of the ergodicity rate. 

Polynomial ergodicity: By Eqs (|2.16|) and (|2.17|) . if ip(v) = v a (with a G 
(0,1)), then r v (k) x /^/l 1 "") an d ^(k) x jfeV(i-«). Therefore, condition 
(|4.1j) - ()4.2j) is fulfilled as soon as for any a G (1/2,1) by any sequence {&„} 
satisfying 



On K 



Subexponential ergodicity: Assume that (p(v) = (v + d)(log(v + d))~ a for 
some a > and sufficiently large d. Then, $ _1 (fc) x e cfc 1/,(1+a) £ or some constant 
c. The condition (|4.H) - (|4.2() is fulfilled by any speed sequence {b n } satisfying 

lim{^ + -ferU(,. 

The result can be extended to the empiral measure of a Markov chain. As- 
sume that X is a Polish space and denote by M (X) the set of finite Borel signed 
measures on X. Denote by B(X) the collection of bounded measurable func- 
tions on X. We equip M(X) with the smallest topology such that the maps 
v i— > J x fdv are continuous for each / G B(X), commonly referred to as the r- 
topology. The cr-algebra M.(X) on M(X) is defined to be the smallest cr-algebra 
such that for each / G B(X), the map v ^ fdv is measurable. Define the 
empirical 

^ n — 1 

L n = T-^fe -7T) . 
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For any B G Ai(X), we denote by int r (-B) and clos T (-B) the interior and the 
closure of the set B w.r.t. the r-topology. 

Theorem 8. Under the assumptions of Theorem^ for every probability mea- 
sure (j, G M(X) satisfying < oo, and any B G A4(X) 



71 

limsup-2-logP M (L n e B)< 

ft 

liminf-2 logP M (L n G B) > - 
n 0± 



where for 7 G X, setting f = f — vr(/), 



" Y 1 ^ J o(7), 

7G clos T (B) 

inf /o(t) 

7 eint T (S) 



sup 
/es(X) 



(4.4) 



The proof can be directly adapted from the proof of |de Acostal . Il997l . The- 
orem 3.2) and is omitted for brevity . An explicit expression of the good rate 



function can be found in (de Acosta 



1993, Theorem 4.1). Other MDP princi- 



ples (for instance, for the supremum of t he empirical process) c an be obtained, 
using the results obtained previously by iDiellout and Guillinl (|200lh . To save 
space, we do not pursue in this direction. 



4.2. Moderate deviations for unbounded functionals of Markov chains. 

We give here conditions allowing to consider unbounded functions. These con- 
ditions make a trade-off between the ergodicity of the Markov Chain, the range 
of speed for which a moderate deviation principle may be established and the 
control of the tails of the functions. 



Theorem 9. Assume A\1\P2\ and that there exist a function tp G G((p) and a 
sequence {K n } such that lim n ^ 00 K n = 00 and, for any positive e, 



y n_ / n 

™&2 0g \^i(eb n /^{K n )) 

n ( n^(K n ) 
km -j log — —— — | = -00 



-00 



(4.5) 
(4.6) 



Then, for any initial distribution fi satisfying fJ,(V) < 00 and any measurable 
function f : X — ► W 1 such that sup x ||/||/^ol/ ; the sequence {er^(A, /, //)} where 



k=0 
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has a limit cr 2 (A, /) (which does not depend on fj,) and [L n (f) G •] satisfies a 
moderate deviation principle with speed b\jn and good rate function Jf, 

J f (x)= sup [(A,x)-(1/2V 2 (A,/)] . 

AeR d 

Moreover, if ip 2 + ?/><!> ^ G G(f), then a 2 (X,f) = <x 2 ((A,/)) and Jf = Jf. 

Polynomial ergodicity: By Eqs (|2.16f) and (|2.17|) . if tp(v) = v a (with a G 
(1/2,1)), then r v {k) x jfe ^ 1 - ) and <$>~ l {k) x fcVa-a). Choose ip(v) = v p 
with [3 < a — 1/2. Then the MDP holds for for any sequence {b n } such that 
linin^ool-^ + ^™ = } = 0. It is worthwhile to note that the speed which can 
be achieved are the same than in the bounded case. 

Subexponential ergodicity: Assume now that tp(v ) = (v + d)(log(v + d))~ a 
for some a > and sufficiently marge d. Then Letting ip(v) = (log(l + v))@ for 
some (3 > 0, then Theorem |5] shows the MDP with speed b n = n a for a such 
that 

1 3+l+a 
- < a < 



2 2/5 + 1 + 2a 
Letting ip(v) = (1 + v) p with (5 < 1/2, then Theorem M shows that the MDP 
principle holds for any s6QUGncG such, that lim n >OQ {^ + -^=} = o. 

5. Deviation inequalities 

We now investigate some exponential deviation inequalities for ^^(Ylk=o /(^) > 
en) valid for each n where / is a bounded and centered function w.r.t. ir. This 
is to b e compared to Be r nstein 's inequality for i.i.d. variables or more precisely 
to the 



Fuk and Nagaevl (I197lh inequali ty adapted to Markov chains, (as done 



in a previous work of lClemenconl (|2001r except that in this paper, the Markov 



chain is not geometrically but sub-geometrically ergodic. Extensions to the case 
of unbounded functions can be tackled using result of Theorem |3J 

Theorem 10. Assume that f is bounded and centered with respect to ir and the 
assumptions of Theorem 1. Then, for any initial measure fi satisfying n(V) < 
oo, for any positive e > and n > no(e), there exists L,K (independent of n 
and e ) such that, for all positive y 



n-l 



> en < 



Ln 



k=0 



<!>- 



+ 



Ln 



11/11 
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The proof is given in section [EJ Let us give a few comments on the obtained 
rate in some examples: with ||/||oo < 1> f° r n>n\ 

(1) <p(v) = (1 + v) a for a £ (1/2, 1), then there exists K 

n-l 



k=0 



> en] < K 



log(n 



i 

l-a 



£l-ayjl-a 



(2) (p(v) = (! + «) log(c + v ) a for positive a, then there exists K, L 



n-l 



k=0 



>en] <K e" 1 ^'^. 



The polynomial rate shown in the first case is better than the one derived 
by Rosenthal's inequality, and considering that we in fact only consider inte- 
grability assumptions, are not so far from optimal when considering stronger 
assumptions as weak Poincare inequalities. The subgeometric case is less sat- 
isfactory in the sense that when a is near 0, we hope to achieve a n in the 
exponential (obtained for example via Cramer argument) whereas we obtained 
instead \fn. The gap here, due to Fuk-Nagaev's inequality, is fullfilled only 
asymptotically via the moderate deviations result, and is left for deviation in- 
equalities for further study. 

Appendix A. Proof of Propositions [T] and [2 

Proof of the Proposition^ We first prove by induction that for all n > and 
all functions fo,---,f n £ •^ r+ (X), 



E,- 



E, 



.1=0 



JJ/i(^i)l{CT>n} 
.i=0 

We first establish the result for n = 0. For / £ ^" + (X) we have 
E A [/pf )%>o}] =%[/(X )l {d0=0} ] = 



(A.l) 



(1 - e) / f(x)u(dx) + / f(x)a(dx) = / {1 - et c (x)}f(x)a(dx), 
Jc Jc c Jx 

Assume now that the result holds up to order n, for some n > 0. Similarly, for 

any / £ ^+(X), 

E[/(X n+1 )l {dn+1=0} | F% V^]t {dn=0} 

= t[f(X n+1 ){l - et c (X n+1 )} | V F%]t {dn=0} 
= E[f(X n+1 ){l - el c (X n+1 )} | X n ]l {dn=0} 
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E,- 



Therefore, by the recurrence assumption, 

n 
i=0 

E[f n+1 (X n+1 ){l - el c (X n+1 )} | X n ] Hfi(Xi)l {a>n] 

n 

E[/ n+ i(X n+ i){l - el c (X n+1 )} | X n ] Hfi(Xi)(l - e) 

n 

f n+1 (X n+ i)l[f i (X i )(l-e) N »+ 1 



Er 



E, 



i=0 



N„ 



i=Q 



showing (|A.1|) . Therefore, the two measures on (X n+1 , ,Y®( n + 1 )) defined respec- 
tively by 

A^E A [t A (X ,...,X n )t { z> n} ] and 
A^E M [l A (X ,...,Xi)(l-e) N »] 

are equal on the monotone class C = {A, A = Aq x • • • x A n ,Ai S X} for any 
n, and thus these two measures coincide on the product cr-algebra. The proof 
of 1)2.10(1 follows upon conditioning upon the events {S = n}. We now prove 
(|2.11|) . By definition of the hitting time a to the atom X x {1}, £<5-]1{ct<og} may 
be expressed as 



oo 



6r%<oo} = ? CT o 1 {d CTO =l} 1 {<i CTO <oo} + Z^^i 1 ^^} 1 ^-!^} 1 ^^}- 

i=i 



Note that 



E 



i{d CT .=i}6> 



X 



l{«»- J <oo} = eE 



1 



{oj<Oo} 



and (1 — e) a i l{o-.,<oo} = (1 — e ) J,+1 l{o- : ,<oo}- The proof follows from the identity 



%[£<7j1{(7j<C»}1{<Tj_1<<7}] = E /i[ E [^ l{<T i <Oo} I ^_ 1 V ^_ 1 ]l{d o .._ 1 =0}l{<T J -_l<ff}] 



E M [E[^l {CT . <oo} | ^*_J(1 - e )^-l K _ 1<oo} ] = (1 - e) J E M [e CTj l K<oo} ]. 



□ 
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Proof of the Proposition^ Without loss of generality we assume that sup^ W Tt9 < 
oo (otherwise the inequality is trivial). In the case e = 1, Proposition [21 is ele- 
mentary since by Proposition^ it then holds that 



Y,r(k)g(X k ) 



k=l 



W rifl (x)l c «=(x). 



Consider now the case e G (0, 1). By applying Proposition ^ we obtain: 



E? 



.k=i 



eW r , g (x)l c ^x) + e^2{l-eyi, 



J2r(k)g(X k ) 



For j > 1, write 

E r (%(^ 



E, 



,fe=l 



i-i 

W r , 9 (x)l Cc (x)+^E a . 



k=l 



(A.2) 



E 



Under the stated assumptions, for all n,m > 0, r(n + m) < Kr(n)r(m). This 
and the strong Markov property imply, for x G {W rt9 < oo} : 



E, 



E 

fc = (T^ + l 



E + 



fc=l 



< [r(^)W" r , s (X^)] < if ( sup W r , 9 ) M x [r(a e )}, 



where 6 is the shift operator. Plugging this bound into ()A.2|) and using again 
Proposition ^ we obtain, 



i>(%(x fc ) 



fc=i 



^ c ' j=i e=o 
= W r , g (x)t C c(x) + K (sup W r , g ) E(l - eY +1 E x [r(ve)] 



£=0 



W r , g (x)l C o(x) + e-\l - e)K ( supW r , g ) E fc [r(*)]. 



□ 
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Proof of corollary^ For any r G A, linij^oo r(n)/ X^fc=i r{k) = 0. As a conse- 
quence, for any r(n) £ A and any 5 > 0, A^ denned by 



A, 



dcf 



r,<5 



sup < n > 1, r(n)/^^r(fe) > 8 > , 



(A.3) 



fc=i 



is finite. For any n > 0, the definition of A,. 5 implies r(n) < <^^fc=i r (^) + 
r(N rt s) ■ Hence, for any x G X, 



%[r(<7)]<(% 



.A.-1 



+ r(A^) 



The proof of (|2.15|) then follows by choosing <5 sufficiently small so that (1 — 
e- 1 (l-e)sup c W r , 1 5y 1 <l + 5. □ 

Appendix B. Proof of Theorem |1] 
We preface the proof by the following elementary lemma. 

Lemma 11. Assume Then, for any ip G Q(<p) there exists (depending 
only and explicitly on b, ip and ip) such that, for all x G X, 



Q(x, fcoF)<fco V(x) -ipo V(x) + b^l c (x 



(B.l) 



Proof. Since <I>^ is concave, differentiable, non decreasing, the Jensen inequality 
implies, for x G" C 

P[$f o V] < ^(PV) < ^{V - ip o V) 

< ^ oV + <f>^(V)(-tp o V) < $4, o V - ip o v 

and 



supQ(x,$^, o V) < 
c* 



(l-e)- 1 <jsu P PV-ei/(y) 

C 



The proof follows. 

Proof. By Corollary |3J we may write 



□ 



E 



Y J ipoV{X k 



k=0 



T-l 



^oV(x k 



.fc=0 



l C c(2;)+sup^ol/ + 6 9 . (B.2) 



On the other hand, the comparison Theorem ([Mevn and Tweediel . Il993l . Theo- 
rem 11.3.1) and the drift condition (jB.!)) implies that 

"r-l 



E, 



fc=0 



i C c(x) < $^oy(i)i C c(i) . 
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The proof of Q2.22JI follows. The proof of (|2.23f) is along the same lines using 
(12~T31) instead of (l2~Tl) . 

We now consider (|2.24j) . Define r\ = f inf{/c > 0, V(X k ) > K}. We consider 
first the event |Efc=o ° V(X k ) > M,r] > <r|, on which ip o V{X k ) remains 
bounded by ijj{K). Therefore, on {77 > a}, ELo^ V(X k ) < (a + l)%b{K), 
which implies that 

{EI =0 ^ V ^ > M ^>°}^{°> M/i/>(K)} . 

We now consider the complementary event: |Efc=o 

We take c G (0,1), Note that, if d < cM/ip(K), then, Efc=o V> V"(X fc ) < 
WH^O < cM which implies that Ylk= v i> ^(^fc) > (1 - c)M. Therefore, 

{El =0 ^ v{Xk) - M ' 77 < *} c ^ - cM m*qi 

U {r? < o- < cM/i>(K) , V ^pf fe ) > (1 - c)M} . 

Therefore, 



— ^cr 

I- ' 
Sx 



% (t? < a < cM/^(K) , Y,l =r] i> V(X k ) > (1 - c)Mj . (B.3) 

The first term of the right hand side of (jB.3|) is bounded using the Markov 
inequality with (|2.23|) . 

™ r „,/,,r,M %{Efc=0 r ^( fc )} V(X)1 C 4X) + 1 

P 4 {* > cM/^)} < $-1 { c M/i/j(K)} * K ° *-HcMMK) } • 

for some finite constant Ko- Similarly, the Markov inequality and the strong 
Markov property imply, using Eq. (|2.22|) . 



77 < d- < cM/if)(K), ^ VC**) > (! - C ) M 

fc=»; 

(1 - c)M 



k=rj 



^77^7% [(** 9 W + 1)1 { ^ 
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for some constant k±. The function u \— > §.^{u)/u is non- increasing. Therefore, 
o + 1)1 { ^ <oo} < K-\^{K) + l)V(X v )t {v<oo} , which implies that 

% [(<fy o v(x„) + i)%>„ } ] < + [V(X v )l {& > v} ] • 

We now prove that there exists a constant K2 such that, for any x E X, 

% lypgi^] < k 2 f(x) . (b.4) 

Since r/ is ./-"^-stopping time, using proposition ^ ()2.1(Jj) . we may write 

% [V(X v )t {v<&} ] = E x [V(X V )(1 - e) N vt {r]<oo} ] . 

By conditioning upon the successive visit to the set C, the RHS of the previous 
equation may be expressed as 



E x [V(X v )(l-e) N -t {ll<oo} ] = 

00 

E x [V(X v )l {r)<ao} ] + ]T(1 - eft [v(X v )l {aj _^ v<aj} ] . (B.5) 
3=1 

Because V(X v )t ^ ^ < V(X„Arm) and r\ A an is a JF^-stopping time, the com- 
parison Theorem f (|Mevn and Tweedid . 119931 . Theorem 11.3.1)) implies that, 
under 



E, [V(X v )l {ri<ao} ] < V(x) + bt c (x) . 
Similarly, for any j > 1, we may write 



(B.6) 



and the comparison Theorem and the strong Markov property imply that 



E, 



v ( x v) 1 W J -i<n<^} 



< [ sup V + b ) . 



(B.7) 



By combining the relations (|B.5|) . ()B.6|) and (|B.7J) . we therefore obtain the 
bound 



E, [V(X V )(1 - e) N *l {v<oo} ] < V(x) + bl c (x) + 
showing (|B.4|) and concluding the proof. 



(1-6) 



sup V + b 

c 



□ 
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Appendix C. Proof of Theorem El 



Proof of Theorem^ By ([Mevn and TweedieL Il993l . Theorem 17.3.6), we only 
need to check that I = E^ j (ELo l/l( x fc)) 2 | < °o. We may write / = h+2I 2 
where the two terms I\ and I2 are respectively defined by 



h = to 



h=&i> 



fc=0 



k=0 



=k+l 



.fc=0 



The proof follows using Theorem |IJ 



□ 



Appendix D. Proof of Theorem [3 
Lemma 12. Assume that A\1V^ hold for some function ip such that inf^g^ 



00) 



> 0. Then, the chain is ergodic of degree two. 



Proof. Recall that for a phi-irreducible Markov Chain, the stationary distribu- 
tion 7 T is a maximal irreducibility measure (see for instance (|Mevn and Tweedie , 
1993, Proposition 10.4.9)), Therefore any set C G X such that tt(B) > is 
accessible. In addition, for any non-negative measurable function /, ir(f) = 
J B n(dx)K x f^lfzo 1 f(Xk))- A dhect calculation shows that 



E x [t%\ = 2E x 



TB-l 
k=0 



Therefore, the Markov chain is ergodic of degree 2 if and onl y if for any B £ X 



f v Tvi dx)^. [trI < 00. The Jensen inequality (see for instance (|Jarner and Robert; 



200ll . Lemma 3.5)) shows that there exis ts two positive constants cp and 6q 
such that PW < y/V — cq + bole, and by ( Mevn and TweedieUl993l . Theorem 
14.2.3), for any x € X, and any B such that tt(B) > 0, there exists a constant 
c(B) such that, for ny x 6 X, 

E x [t b ] < VV(x) + c(B) . 



Applying to the inequality PV + cyV < V + blc shows that 7r(v V) < 00, 
which concludes the proof. □ 
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We will only give here the scheme of the proof generalizing the approach 



of 



Diellout and Guillinl ([20011 ) . based on the renewal method introduced (for 



discrete Markov chains) by Doeblin. Let us first recall the following crucial 
result due to Arcones-Ledoux: suppose that {Ui} are i.i.d. random variables, 
then b~ l Efc=i Uk satisfies a MDP if and only if 



n 



lim log (nP (||i7 fe || >b n )) 



-CO 



and the rate function is the natural quadratic one. Note that by an easy ap- 



proximation arg ument 
alizing result by 



at le ast in the finite dimensional case) and thus gener- 



Chen 



19971 L the previous condition gives also the MDP for a 



1-dependent sequence {Ui}. 

The renewal approach consists in splitting the sum S<n 
four different terms: 



dof 



E 



into 



e(n) 

Sn = ^ £k + S&oAn + 
fc=l 



where cfq = f a and 




e(n) 

£ 

k=l 



n-1 

+ E 

i=(K«)+i) 



(D.l) 



inf{n > <7fc_i;d n = 1} are the successive return times 
to the atom of the split chain, i(n) = f Ylk=o ^(dk = 1) is the number of visits 
the atom before n, e(n) = [eir(C)n\ is the expected number of visits to the 
atom before n, l(n) = f &(i( n )-i)A0 i s the index of the last visit to the chain 



dcf 



to the atom and =* Yl'j=& k _ 1 +i fip^-j) ls the /-modulated moment of the 
excursion between two successive visits to the atom. 

The general idea is to show that only the first term contributes to the mod- 
erate deviation principle. To this end we make the following remark: it can be 
easily checked that is a sequence of i.i.d. random variables with common 
distribution 

O"0 



P(6 e 



J=0 



Note that, when m > 1 in then the sequence becomes 1-dependent but 
essentially the same argument can be carried out. Under (|4.5j) - (|4.6|) . it is easily 
seen that 



lim — r log < n 



£/(**: 



k=0 



> b n 



-oo 



so that the first term satifies a MDP, the identification of the rate function 
being easily handled. 
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Consider now the three remaining terms of the right hand side of HD.lj) . We 
have to show that, for any positive e 



n 



lim sup 72 log P/i (H^oAnll > tb n ) = oo, 



n 



lim sup -j log P^ 

n— >oo 0„ 



Tl - 

lim sup -J log P A 

n—>oo n 



n-1 

E K X i) 

j=l(n)+l 
i(n)—l e ( n ) 

E 

j=l k=l 



-OO, 



-oo. 



(D.2) 
(D.3) 

(D.4) 



Remark that the condition ensuring the MDP gives directly the first two 
needed limits. The last one is more delicate, but as seen from the proof done 
in the atomic case it merely resumes to the MDP of (cr^ — (Jk-i — ( e7r (C)) _1 ) 
(given by Arcones-Ledoux result and (j4.5jl ) which enables us to prove that in 
the sense of moderate deviations the difference \i{n) — e(n)\ can be arbitrarily 
considered of size [Sn\ (5 beeing arbitrary), and the MDP of the sum of [5n\ 
blocks (£fc). This last term being clearly negligible as 5 is arbitrary. 



Proof of the Theorem^ The proof of Theorem |H] follows from the projective 
limit theorem and from the moderate deviation principle for bounded func- 
tions (as stated in Theorem |7|. The key point consists in checking that the 
rate function as expressed in Eq. (j4.3j) . Theorem El coin cides with t he on e ob- 
tained by the projec t ive lim it theorem (see for instance Ide Acostal ()1997l ) and 



de Acosta and Cher] jl99Sh). 



□ 



Appendix E. Proof of Theorem E3 

We will the same decomposition than in the moderate deviations proof, i.e. 
decomposition (|D.1I) 

i(n)— 1 n-l 

s n = % o)An + E &+ E 

fc=l i=(/(n)+l) 
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We bound 



Efc=d f( x k)\\ > en) by Yh=i J i, where 



h 



def ™ 



n-1 



E/( x *) 



k=0 



> en, d"o > n 



L 1 1^*0 1 1 > "3") 



def ™ 



def A 



> 



i(n)-l 

E 6 

fc=l 

n-1 

E 

i=(i(n)+l) 



> 



en 



where 



/i<P A (ao>n)< ¥ ^, 



by Theorem 0] if fJ,(V) < 00. Remark also 

en 



h < P/i ( <70 > 



< 



and if v(V) is bounded, 



£4 < Pa ( max (d- fc - o-fc-i) > 



fc</+l 



For the last term, note 



< (n + 1)P* cr > 



en 



1 < 



L(n+1) 



1 / £71 



J 3 < P A max 



fc=i 



< 2P A 



E& 

^=1 



> 



> 



en 

IT 



en 



where the last step follows by Ottaviani's inequality for i.i.d.r.v. if for n large 
enough 



maxl 



k=i 



en \ 

> T <1A 



By Chebyschev's inequality, independence and zero mean of the it is 
sufficient to choose n such that 



n > 



7211/11^(07 + 1) 



2(i 
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where E#((<7 + l) 2 ) is finite (and can be easily evaluated) under our drift con- 
dition. 

By using the Fuk-Nagaev inequality for the remaining term, we get that for 
all y > 



where E£ 2 is easily controlled under the drift condition. This concludes the 
proof. 
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